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Marginal stability is the notion that stability is achieved, but only barely so. This property con¬ 
strains the ensemble of configurations explored at low temperature in a variety of systems, including 
spin, electron and structural glasses. A key feature of marginal states is a (saturated) pseudo-gap 
in the distribution of soft excitations. We study how such a pseudo-gap appears dynamically in the 
case of the Sherrington-Kirkpatrick (SK) spin glass. After revisiting and correcting the multi-spin- 
flip criterion for local stability, we show that stationarity along the hysteresis loop requires that soft 
spins are frustrated among each other, with a correlation that diverges as C(A) ~ 1/A, where A is 
the larger of two considered local fields. We explain how this arises spontaneously in a marginal 
system and develop an analogy between the spin dynamics in the SK model and random walks in 
two dimensions. We discuss the applicability of these findings to hard sphere packings. 


Introduction: In glassy materials with sufficiently long- 
range interactions, stability at low temperature imposes 
an upper bound on the density of soft excitations [1]. In 
electron glasses [2-7] stability toward hops of individual 
localized electrons requires that the density of states van¬ 
ishes at the Fermi level, exhibiting a so-called Coulomb 
gap. Likewise, in mean-field spin glasses [8-15] stabil¬ 
ity towards flipping several “soft” spins implies that the 
distribution of local fields vanishes at least linearly. In 
hard sphere packings the distribution of forces between 
particles in contact must vanish analogously, preventing 
that collective motions of particles lead to denser pack¬ 
ings [16-18]. Often, these stability bounds appear to be 
saturated [6, 9, 15,17, 19, 20]. Such marginal stability can 
be proven for dynamical, out-of-equilibrium situations 
under slow driving at zero temperature [1] if the effective 
interactions do not decay with distance. This situation 
occurs in the Sherrington-Kirkpatrick (SK) model [de¬ 
fined below in Eq. (1)], but also in finite-dimensional hard 
sphere glasses, where elasticity induces non-decaying in¬ 
teractions [21]. This result is also obtained for the ground 
state or for slow thermal quench by replica calculations 
in spin glass [10, 22] and hard sphere systems [23, 24] 
assuming infinite dimension. 

The presence of pseudo-gaps strongly affects the phys¬ 
ical properties of these glasses. The Coulomb gap alters 
transport properties in disordered insulators [2, 3], while 
its cousin in spin glasses suppresses the specific heat and 
susceptibility. It was recently proposed that the singu¬ 
lar rheological properties of dense granular and suspen¬ 
sion flows near jamming are controlled by the pseudo¬ 
gap exponents in these systems [25]. More generally, 
an argument of Ref. [1] shows that a pseudo-gap implies 
avalanche-type response to a slow external driving force, 
so-called crackling [26]. This is indeed observed in these 


systems [6, 9, 27]. Despite the central role of pseudo-gaps, 
it has not been understood how they emerge dynamically, 
even though some important elements of the athermal 
dynamics of the SK spin glass have been pointed out in 
earlier works [11, 12]. 

In this Letter we identify a crucial ingredient that was 
neglected in previous dynamical approaches, and also 
in considerations of multi-spin stability: Soft spins are 
strongly frustrated among each other, a correlation that 
becomes nearly maximal for spins in the weakest fields. 
These correlations require revisiting earlier multi-spin 
stability arguments that assumed opposite correlations. 
We then argue, assuming stationarity along the hystere¬ 
sis loop, that the correlation C(A) between the softest 
spins and spins in local fields of magnitude A must follow 
C{ A) ~ 1/A 7 , with 7=1. This is built into a Fokker- 
Planck description of the dynamics, which is used to pre¬ 
dict the statistics of the number of times a given spin 
flips in an avalanche. 

Model: We consider the SK model with N Ising spins 

(s» = ±1): 
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in an external field h. Every spin couples to all other 
spins j via a symmetric matrix J^-, whose elements are 
i.i.d. Gaussian random variables with mean 0 and vari¬ 
ance 1/N. The total magnetization is M = ]TL,Sj. We 
define the local field h, and the local stability A j of spin 
i by 
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A spin is called stable when it aligns with the local field, 
A > 0, and unstable otherwise. The energy to flip the 
spin Si —> —Si (and hence A* —> —A*) is: 

A Ui(i) = 'H(-Si) -H = 2 s t (J2 JijSj + h)= 2A,. (3) 

As in Ref. [9], we consider the hysteresis loop at zero 
temperature obtained by quasi-statically increasing the 
field, as shown in Fig. 1(a). When a spin turns unstable, 
we apply a greedy Glauber dynamics that relaxes the 
system in an avalanche-like process toward a new one- 
spin-flip stable state by sequentially flipping the most 
unstable spin. Those states empirically exhibit a pseudo¬ 
gap in the distribution of the Aj [9, 11, 15], 

p( A) = AX S + 0(N~ e ^ 1+e '>), (4) 

with 9 = 1 for A <C 1, as shown in Fig. 1(c), but with a 
slope A significantly larger than in equilibrium [10, 12, 
28]. The avalanche size is power-law distributed [9]: 

D(n) = n~ T d(n/N a )/E(N), (5) 

where n is the number of flips in an avalanche. The 
scaling function d(x ) vanishes for x 1. N a is the finite 
size cutoff, and S(7V) is a size dependent normalization 
if r < 1. Numerical studies of the dynamics of the SK 
model indicate that r = cr = 1 and S = In TV [9, 15], as 
shown by the finite size collapse in Fig. 1(b). While one 
can argue that 8 = 1 along the hysteresis curve [ 1 ], the 
exponents r and a have not been derived theoretically 
for the dynamics (unlike for “equilibrium avalanches”, 
for which r = 1 has been obtained analytically [13, 14]). 

Below we present a theoretical analysis of the dynam¬ 
ics, making the following two assumptions: 

(i) Contained Avalanches: Spins never become 
strongly unstable, that is, the lowest local stability en¬ 
countered in an avalanche, Ao, satisfies Ao —> 0 as 
N —> oo. This has been numerically verified in Fig. 3(a). 

(ii) Stationarity: The number of times each spin flips 
along the hysteresis loop diverges with N for any finite 
interval of applied field [h. h + Ah] if h = 0(1). This 
assures that a stationary regime is reached very quickly. 
(For r = 1 this condition simply reads <7 +1/(1 +0) > 
1) [29], 

Multi-spin stability criterion: A static bound for the 
pseudogap exponent 6 is obtained by considering two of 
the softest spins i,j (with stabilities A m i n ~ l/N 1 ^ 1+e ' > ) 
[1, 30, 31]. Their simultaneous flip costs an energy 2(A^ + 
A j — 2 SiSjJij). The last term scales as 1/y/N and is 
negative if the two spins are unfrustrated. If this occurs 
with finite probability, a strong enough pseudogap, 9 > 1, 
is necessary to prevent the last term from overwhelming 
the stabilizing terms. However, extending this argument 
to multi-spin stability reveals its rather subtle nature. 



FIG. 1. (a) Hysteresis loop: Magnetization M under a peri¬ 
odic quasi-static driving of the external field h. Inset: mag¬ 
nified segment of the hysteresis loop of a finite size system, 
(b) Finite size scaling of avalanche size distribution D(n) con¬ 
firms t = a = 1 up to logarithmic corrections, (c) Distribu¬ 
tion of local stabilities, p( A), in locally stable states along the 
hysteresis loops for different system sizes N. (d) Correlation 
— ( Jss) between the least stable spin and spins at local sta¬ 
bility A in locally stable states along the hysteresis loop. The 
data for different system sizes collapses. 

Flipping a set F of m spins in an initial one-spin flip 
stable state costs an energy 

A U(T) = 2^ A; - 2 (6) 

itzJ 7 ijj'G.F 

The initial state is unstable to multi-flip excitations if 
AH < 0 for some T. Refs. [30, 31] considered just the 
set of the m softest spins. Extremal statistics and the 
assumption of Eq. (4) implies the scaling of the maximal 
stabilities A (to) ~ (m/N) 1 A 1 + e ) ; and thus J2i< m ^ ~ 
m\(m). The term ]>+ <m Jij s i s j ~ m(m/A r ) 1 / 2 was 
(erroneously) argued to be positive on average , which 
yielded the bound 9 > 1 to guarantee A H m > 0. How¬ 
ever, numerically we find that on average 
is negative for soft spins. More precisely, the correla¬ 
tion C(A) = —2 (Jss) between a spin of stability A and 
the softest spin in the system is positive for small A, as 
shown in Fig. 1(d). Postulating that: 

(7(A) - A ~^N~ S , (7) 

it is straightforward to estimate that (— Y^i<m Jij s i s j) ~ 
m 2 C(\(m)) ~ m 2- 7 /(i+0)_/v7/(i+0)-<5. A more complete 
characterization of correlations is given in the Supple¬ 
mentary Materials Section A and B. 

It follows that the average r.h.s. of Eq. ( 6 ) is always 
positive. We argue that the stability condition never- 





















3 


theless leads to a non-trivial constraint, because the last 
term of Eq. (6) can have large fluctuations. Indeed, con¬ 
sider all sets J of m spins belonging to the m! > m 
softest spins. For definiteness we choose m' = 2m 
and use scaling arguments. A more detailed deriva¬ 
tion for a general ratio to'/to is given in the Supple¬ 
mentary Materials Section A. To estimate the proba¬ 
bility that the optimal set leads to a negative AH in 
Eq. ( 6 ), we use a type of argument as often applied in 
the random energy model [32]. We assume that the AH 
associated with different T are independent, Gaussian 
distributed variables. The variance of the fluctuation 
X = y A j£J~ '/b( A A Jij &iS fl) is of order m/yjN. 

Since there are 2 2m sets E, the number density having 
fluctuation X follows N(X) ~ exp[2m ln(2) — X 2 N/m 2 }. 
The most negative fluctuation Ai m ; n is determined by 
A/’(X m i n ) ~ 1 leading to X m \ n ~ —m 3 ^ 2 /\/N. The as¬ 
sociated energy change is thus, according to Eq. ( 6 ) and 
the subsequent estimates of each term: 

AH(X min ) =m^ +e)l{1+e) /N 1/(1+0) H 

m 2-^/(l+e) N1 ,/(l+0)-6 _ (g) 

Multi-spin stability requires that for large N and fixed m 
this expression be positive. This yields the conditions: 

9> 1, or 7/(1 + 9)- 6 >- 1 / 2 . (9) 

However, the correlation in Eq. (7) cannot exceed the 
typical coupling among spins, C < l/VN , which requires 
7/(1 + 9) — S < —1/2. Thus, if 9 < 1 , stability imposes 
the equality 7/(1 + 9) — S = —1/2, while the scaling with 
m 1 additionally requires 2 — 7/(1 + 9) > 3/2; or in 
other words, 7 < (l + 0)/2 < 1 and S < 1. In the relevant 
states, all three exponents 9 , 7 , and <5 turn out to equal 
1 and thus satisfy these constraints as exact equalities. 
We will now show how to understand this fact from a 
dynamical viewpoint. 

Fokker-Planck equation: Consider an elementary spin 
flip event in the greedy relaxation dynamics, cf. Fig. 2. 
The local stability of the flipping spin (colored red and la¬ 
belled 0 ) changes from Ao to —Ao as the spin flips from so 
to —so- Due to the coupling Joj, the local stability of all 
other spins j, colored green or blue, changes accordingly, 

A j —A j = A j — 2 ./(j r sos ) . ( 10 ) 

These kicks have a random fluctuating part, as well as 
a mean value due to the correlation between the spins 0 
and j. Following [11, 12] we model this dynamics via a 
Fokker-Planck equation for the distribution of local sta¬ 
bilities p(X 1 t): 

d t p{\ t) = -d\ [u(A, t ) - d\D(X, t)} p{ A, t) 

— S(X — Ao) + <5(A + Ao), (11) 

where t is the number of flips per spin that have taken 
place. v(Xfl) = —2A7(J 0 iSoSi)Ai=A = NC(X,t) is the 
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FIG. 2. Illustration of a step in the dynamics, in the SK 
model and the random walker model. Circles on the A-axis 
represent the spins or walkers. At each step, the most unsta¬ 
ble spin or walker (in red) is reflected to the stable side, while 
all other spins or walkers (in green or blue) receive a kick and 
move. The dashed and solid line outlines the density profile 
p(A) ~ A for A > 1/%/iV. The blue spins were initially frus¬ 
trated with the flipping spin 0. They are stabilized and are 
now unfrustrated with 0. In contrast, green spins become are 
frustrated with spin 0 and are softer now. Because of the 
opposite motion of spins according to their frustration with 
spin 0, a correlation builds up at small A, leading to an overall 
frustration of “soft” spins among each other. 

average drift, and D(X,t) = N (4(Jgj) — [v(X,t)/N] 2 ) /2 
is the diffusion constant. For A I/a/TV, D = 2. 

For the dynamics to have a non-trivial thermodynamic 
limit the scaling v ~ 0(1) or (JoiSoSi) ~ 1/N must hold, 
i.e., S = 1 in Eq. (7). 

Next we use our assumption (i) that Ao —> 0 in the 
thermodynamic limit. We may then replace the delta- 
functions in Eq. (11) by a reflecting boundary condition 
at A = 0, 

KA, t ) - d\D{X 1 *)] p( A, t) | A=0 = 0 . ( 12 ) 

Our stationarity assumption (ii) implies that finite in¬ 
tervals dh along the hysteresis loop correspond to diverg¬ 
ing times At —> 00 , that is, a diverging number of flips 
per spin. At those large times a dynamical steady state 
(ss) must be reached. In such a state the flux of spins 
must vanish everywhere: 

u ss (A) = Dd xPss {X)/ Pss {X) -»■ 29/X (13) 

A similar result was obtained in Ref. [12] following a 
quench. 

Emergence of correlations: Eq. (13) implies that 7 = 1 
in Eq. (7), assuming Eq. (4) for p ss . Such singular cor¬ 
relations are unexplained [33]. We now argue that they 
naturally build up in the dynamics through the spin-flip 
induced motion of stabilities of frustrated and unfrus¬ 
trated spins, as illustrated in Fig. (2). To quantify this 
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effect we define respectively C/(A) and C/(A) as the cor¬ 
relation between the flipping spin 0 and the spins at A 
before and after a flip event. The quantity Xi = —2JoiSoSi 
is the kick in the stability of spin i due to the flip of so, 
A- = A i + Xi. The correlation C/(A) is the sum over the 
contributions from all spins which migrated to A due to 
the flip: 

C' f (X) = j p{X — x)(—x)f\- x (x)dx, 
p'{ A) = J p( A - x)f\- x (x)dx. 


Here f\(x) is a Gaussian distribution of the random vari¬ 


able x at A: f\(x) = exp 


/x/4jtD/N. Ex- 


(x-c f (\)Y 

4 D/N 

panding in the integrands p (A — x) and Cf(X ~ x) for 
small x and keeping terms of order 1 /TV, we obtain 




p\\) = p( A) - d x 


D 


C/(A)p(A) - -dxp(X) 


(14a) 

(14b) 


Fig. 3(b). Using the same analogy, we predict that the 
distribution of times between successive flips of a given 
spin goes as P(St) ~ l/(<5t[ln(<5f)] 2 ). 



FIG. 3. (a) The average dissipated energy AH in avalanches 
of size n scales as nkin/y/N. —AH/n is a measure of the 
typical value of the stability of most unstable spins, Ao(n). 
thus, in the thermodynamic limit, Ao <C 1 even for very large 
avalanches, (b) The average number of times, F(n), spins 
active in avalanches of size n re-flip later on in the avalanche. 


Thus, even if correlations are initially absent (C/(A) = 
0), they arise spontaneously, C/(A) = 2Dd\p(X)/N p(X). 

In the steady state, p' ss = p ss . Eq. (14b) then im¬ 
plies the vanishing of the spin flux, i.e., Eq. (13) with 
v = NCf. Plugged into Eq. (14a), we obtain that the 
correlations are steady, too, 

C}(A)=C,(A) = Md = J4 (15) 

These correlations are expected once the quasi-statically 
driven dynamics reaches a statistically steady regime, 
and thus should be present both during avalanches and 
in the locally stable states reached at their end. 

Interestingly, Eq. (15) implies that all the bounds of 
Eq. (9) are saturated if the first one is, i.e., if 6 = 1. 
The latter value was previously derived from dynami¬ 
cal considerations in Ref. [1]. It is intriguing, that the 
present Fokker-Planck description of the dynamics does 
not pin 6, as according to Eqs. (13, 15) any value of 6 
is acceptable for stationary states. However, additional 
considerations on the applicability of the Fokker-Planck 
description discard the cases 0 > 1 and 6 < 1, as dis¬ 
cussed in the Supplementary Materials Section C. 

It is interesting to observe that Eqs. (11, 12, 13) with 
6 = 1 are equivalent to the Fokker-Planck equation for 
the radial component of a two-dimensional unbiased dif¬ 
fusion (the analogy is derived in Supplementary Mate¬ 
rials Section D), whose statistics is well known [34, 35]. 
We can use this analogy to predict F(n), the number of 
times an initially soft spin flips in an avalanche of size n. 
Indeed, a discrete random walker starting at the origin 
will visit that point ln(i) times after t steps in two dimen¬ 
sions, thus F(n) ~ ln(n). This prediction is confirmed in 


Conclusions: We have studied the quasi-static dynam¬ 
ics in a marginally stable glass at zero temperature, fo¬ 
cusing on a fully-connected spin glass as a model sys¬ 
tem. Our central result is that the pseudo-gap appears 
dynamically due to a strong frustration among the soft¬ 
est spins, characterized by a correlation function C(A) 
which scales inversely with the stability A. We provided a 
Fokker-Planck description of the dynamics that explains 
the appearance of both the pseudo-gap and the singular 
correlation, and suggests a fruitful analogy between spin 
glass dynamics and random walks in two dimensions. 

We expect that our findings apply to other marginally 
stable systems, in particular hard sphere packings 
that display a pseudo-gap with a non-trivial exponent: 
P(f) ~ f 9e [16, 17, 20, 23] where / is the contact force. 
Our analysis above suggests that a singular correlation 
function C(f) ~ Iff characterizes how all contacts are 
affected by the opening of a ‘soft’ contact, i.e., by push¬ 
ing two weakly-interacting particles apart (the relevant 
excitations in packings [16, 17]). On average, contacts 
carrying small forces should see their force increase by 
C(/), a testable prediction. It also suggests a connection 
between the dynamics and a random walk in a space of 
dimension 1 + 6 e that will be interesting to explore fur¬ 
ther. 
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A. STABILITY CRITERION 

Consider flipping m spins selected from the set of the 
m' (m 1 > m) least stable spins. We make the approxi¬ 
mation that the exchange energy of such multi-flip exci¬ 
tations is a random Gaussian variable when m is large, 
as supported by Fig. SI. The mean and the variance of 
AH are: 

At = (AH) = 2m ((A) m / - m(Jss) m >), (Sla) 
a 2 = (AH 2 ) - (AH) 2 = 8 m 2 /N, (Sib) 

where we have neglected the contribution from the non¬ 
diagonal terms of (]T Jss y Jss). We also omitted the 
fluctuations of the sum yb A ? ;, since that sum is any¬ 
how always positive, and at large m its fluctuations are 
smaller than its expectation value. The maximal stability 
in the set of m' spins is 



and the mean values of the local stability, (A) m >, and the 
correlation ( Jss) m / are by definition, 

(A )m' = f m p( A)AdA/ [ p( A)dA, 

Jo Jo 

(Jss) m , = ~ / Am ' dA f Xm ’ dA'C(A, \')/A 2 m ,. 

1 Jo Jo 

Here C( A, A') is the correlation between the spins at the 
finite local stabilities A > 0 and A' > 0, defined as 

C(A, A') = —2(JijSiSj)\x i= x t \ j= x' 

- N 2 p(\)p(\') ^ S ( Xi ~ A ' )<5( ' Aj “ 

l i3 

(S2) 

In the above p(A) = yb<5(A i — A )/N is the density of 
stabilities. 
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C(A, A') is a symmetric function, and continuous ex¬ 
cept for the singular point A = A' = 0. Defining 
the correlation C(A) = C(A, A' = 0) between a sta¬ 
ble (A > 0) and a soft spin (A' = 0), we find that 
it behaves as a power-law, described by Eq. (7) in the 
main text. As far as scaling is concerned we thus expect 
C(A, A') ~ C(max[A, A']). In Section B we find numeri¬ 
cally that C{ A, A') « C(yA 2 + A' 2 ). 




FIG. S2. The lower data set in solid lines is the total 
energy AT-L{n) dissipated in avalanches of size n. The upper 
data set in dashed lines is the sum of local stabilities (before 
the avalanche) of spins that are going to flip in the avalanche, 
)r\ flip A,. This shows that the dissipated energy is vanishingly 
small as compared to the naive sum over local stabilities, as 
n —» oo, since the two curves scale as different power laws 
with n. 


FIG. SI. Histogram of excitations with given energy change 
AH for different metastable states along the hysteresis curve, 
m = 8, m! = 16, and N = 3000. 


Assuming the pseudo-gap distribution of Eq. (4) to¬ 
gether with Eq. (7) of the main text, one finds for 
1 <C m < m! <C IV: 

2 to 3 / 2 / 1/2 m' 1 /( 1+e ) 6 1 / 2 m 1 / 2 A 

M “ AA/D+S) V TO 1 / 2 + jV<5-(l+7)/(l+0) m '7/(l+0) J 


where a and b are numerical prefactors. Note that the 
variation of /j, from states to state in Fig. SI is presumably 
a consequence of the small values of m,m' used there. 

Among all excitations of to out of m! spins, the number 
of sets that lower the total energy, AH < 0, is 


fl(m, m!) 



m!(m' — to)! 


exp 



where $ is the complementary error function. 

We define a free energy as the logarithm of D, 

f(r) = -In Q ~ — r In r + (r — 1) ln(r — 1) (S3) 

TO 

+ %2/(i+e) (rn\^§ b 2j/(1+e) m^/d+g) 

4 \N J 4 ^ 25 - 1 - 27 /( 1 + 0 ) ’ 

where r = m! /to. The cross term (~ (A) m '(Jss) m ') in 
/t 2 has been neglected, as it cannot diverge faster than 
the terms in the second line of Eq. (S3). A positive 
/(r) implies no unstable excitations of the initial state 
in the limit to 1. Stability is thus achieved if either 
term in the second line of Eq. (S3) diverges as to — > oo. 
This requires that either 6 > 1, or 7 < 1 and 6 < 1, as 
explained in the main text. 


In the marginal case, 6 = 7 = 6 = 1, the free energy 
becomes: 

/(r) ~ —r Inr+(r—l) ln(r—l) + —(S4) 

4 r 

An interesting finding is that f(r) is minimized by a fi¬ 
nite ratio r*, independently of the set size to. r* is an 
estimate of the optimal volume m'* = r*m for finding 
energy lowering subsets of size to. 

The fact that stability is controlled by the ratio r in¬ 
stead of the absolute values of to or m! is consistent with 
the observation that the dynamics proceeds via power- 
law avalanches with no scales (a fact implied by the ar¬ 
gument of Ref. [1]). Indeed in the marginal case multi¬ 
flip excitations can be slightly unstable (as illustrated 
in Fig. SI), and can be triggered as the magnetic field 
is increased. Marginality is apparent when analyzing 
these avalanches: We find that the energy dissipated in 
avalanches is much smaller than the naive estimate which 
sums all local stabilities of spins that are going to flip in 
the avalanche, 5V flip V This reflects the fact that the 
total energy change in the avalanche, AH, is a result of 
a near cancellation of several terms, as discussed in the 
main text, verified in Fig. S2. 


B. TWO-POINT CORRELATION 

We numerically measured the two-point correlation, 
and found NC( A, A') = D/y /[A + c{N)} 2 + [A' + c(N)} 2 
as long as A, A' 1. Here, c(N) = l.l^/Im N/N is 
a finite size correction which vanishes in the thermo¬ 
dynamic limit. This result is illustrated in Fig. S3. 
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When finite size effects are negligible this implies that 

C(X,X') & C{y/X 2 + X”). 



FIG. Sib_ Left: _ the quantity 

NC( A, A')^/(A + c(N)) 2 + (A' + c(N)) 2 is numerically 
computed for various A and A / , and behaves nearly as a 
constant (as the color code indicates, this quantity only 
changes by a factor 3 in the entire range considered. Right: 
Correlation C{ A, A'), for A' = 5A with different system sizes 
N and for different directions A' = a A, a = 0,1,2,5 with 
N = 5000. 


C. DYNAMICAL CONSTRAINTS ON 6 

In the main text we argue that the density of local 
stabilities p( A) satisfies a Fokker-Planck (FP) equation 
of the type: 

d t p(\,t) = -d\ [v(X,t) - d\D(X,t)]p(X,t), (S5) 

with a reflecting boundary at A = 0. In addition, we 
show that correlations emerge dynamically, which in the 
steady state take the form: 

C(X)N = v ss (X) = Dd xPss {X)/ Pss (X). (S6) 

These results seem to imply that the fact that correla¬ 
tions are necessary to obtain a steady state, is not con¬ 
straining the latter in any way. Indeed, any function 
Pss(X) could in principle appear as a steady state, as long 
as the correlations satisfy Eq. (S6). This is true in partic¬ 
ular for any scaling function p ss (X) ~ A e , whatever the 
value of 9. However, we now argue that only the case 
9 = 1 is a viable solution in SK model. 

Excluding 9 < 1: Our FP description only applies be¬ 
yond the discretization scale of the kicks due to flipping 
spins, which are of order J ~ 1/y/N. In particular, from 
its definition, C( A) must be bounded by 1/y/N. Taking 
this into account, Eq. (S6) should be modified to: 

v ss (X) « min{Dd\p ss {X)/p ss (X) ~ 1/A, y/N}. (S7) 

This modification has no effect when 9 > 1, since in that 
case A m in ~ > 1/y/N. In contrast, pseudo¬ 

gaps with 9 < 1 have A m in "Cl/ y/N. To maintain such 
a pseudo-gap in a stationary state, one would require 
correlations much larger than what the discreteness of 


the model allows. Pseudo-gaps with 9 < 1 are thus not 
admissible solutions of Eqs. (S5, S7). 

Excluding 9 > 1: In this case, A m j n 1/y/N ~ J. 
Thus when one spin flips, the second least stable spin 
will not flip in general, and avalanches are typically of 
size unity [1]. It can easily be shown that in that case, 
our assumption (ii) in the main text is violated: the num¬ 
ber of flips per spin along the loop would be small (in fact 
it would even vanish in the thermodynamic limit, which 
is clearly impossible). In terms of our FP description, the 
motion of the spin stabilities due to other flips would be 
small in comparison with the motion of the stabilities in- 
between avalanches, due to changes of the magnetic field. 
Making the crude assumption that the magnetization is 
random for any A, the change of external magnetic field 
leads to an additional diffusion term in the Fokker-Planck 
equation: 

d t p(X, t) = -d x (v - Dd x )p{X,t) + D h d x p(X,t), (S8) 

where the term Dh is related to the typical field incre¬ 
ment /z m in ~ A m in required to trigger an avalanche. In¬ 
deed D h ~ Nh‘i in ~ JV’CS-iVp+i) > D ~ 1. Under 
these circumstances, Eq. (S6) does not hold. The dynam¬ 
ics would be a simple diffusion with reflecting boundary, 
whose only stationary solution corresponds to 9 = 0, vi¬ 
olating our hypothesis 9 > 1. 

D. ANALOGY TO A d DIMENSIONAL RANDOM 
WALK 

Consider a non-biased random walk in d dimension, 

x(t + df) = x(t) + y/2Ddtff(t ), (S9) 

where D is the diffusion constant, and ff is a random 
Gaussian vector. Then the probability density P(x,t) 
satisfies the Fokker-Planck equation [36], 

d t P(x,t) = DV 2 P(x, t). 

The process is angle-independent, so P(x, t ) satisfies, 

d t P(r , t) = Dd 2 P(r , t) + D^——^-d r P(r, t), (S10) 

r 

where r = |x|. However, P(r,t) is not a probability den¬ 
sity with respect to r. Including the Jacobian of the 
change of variables, the probability density, p(r, t ) = 
P(r,t), satisfies the corresponding Fokker-Planck 
equation, 

d t p(r, t) = -d r - Dd^j p(r, t ), (Sll) 

with fid the solid angle in d dimensions. This Fokker- 
Planck equation for the radial component of a d- 
dimensional unbiased random walk is exactly the same as 
















the diffusion equation, Eq. (11), with reflecting bound- The case of pseudo-gap exponent 9 = 1 in the spin model 

ary at A = 0 and diverging drift v(\) = 9 /A at small A. thus maps to a two-dimensional random walk. 


